A semi-discrete fourth-order finite volume method is introduced to solve multi-dimensional magnetohydrodynamic (MHD) problems. This method employs a dimension by dimension approach followed by one dimensional fourth-order centrally weighted essentially non-oscillatory reconstruction (CWENO) to compute higher order point values of the physical quantities. Density, momentum and energy are discretized as volume averages. However, magnetic fields are discretized as area averages on the grid cell interfaces.The conservative semi-discrete finite volume scheme is combined with the constrained transport (CT) technique to enforce the divergence-free constraint on the magnetic field. Various 1D, 2D and 3D tests are performed to confirm fourth order accuracy, shock capturing nature and divergence-free property of the scheme.